TITS ALTERNATIVE IN HYPEKAHLER MANIFOLDS 



KEIJI OGUISO 

Dedicated to Professor Yukihiko Namikawa on the occasion of his sixtieth birthday 



Abstract. We show an analogous result of the famous Tits alternative for 
a group G of birational automorphisms of a projective hypcrkahcr manifold: 
Either G contains a non-commutative free group or G is an almost abelian 
group of finite rank. As an application, we show that the automorphism groups 
of the so-called singular K3 surfaces contain non-commutative free groups. 



1. Introduction - Background and main results 

Our main results are Theorems (1.1)-(1.3) and (2.6). Though our actual proof 
is entirely algebraic, these results are much motivated by recent important works 
about automorphisms of K3 surfaces from the view of complex dynamics, notably, 
a work of McMullen [Mc] and works of Cantat [Cal, 2]. 

1. Throughout this note, we work over the complex number field C. By a hy- 
perkdhler manifold we mean a compact simply-connected complex Kahler manifold 
M having everywhere non-degenerate holomorphic 2-form <jm s.t. H 2 (M,£Im) = 
Co~m- Such manifolds are even dimensional and form one of the three fundamental 
building blocks of compact Kahler manifolds of vanishing first Chern class. K3 
surfaces are nothing but hyperkahler manifolds of dimension 2. We also note that 
the Hilbert scheme Hilb™ (S), of O-dimcnsional closed subschemes of length n of a 
K3 surface S, is a hyperkahler manifold of dimension 2n. We refer to the readers 
the excellent account [JHG, Part III] by Huybrechts about basics of hyperkaher 
manifolds. All of what we need here are also reviewed in [Ogl, Section 2]. We 
denote the bimeromorphic (resp. biholomorphic) automorphism group of M by 
Bir M (resp. Aut (M)). By an almost abelian group of finite rank, say r, we mean a 
group G which containing a subgroup A of finite index which fits in with the exact 
sequence 

I — > F — > A — > Z r — > . 

(See eg. [Ogl, Section 9].) The extreme counter part of an almost abelian group 
is a group which contains a non-commutative free group, or equivalently, a group 
having a subgroup isomorphic to the free product Z * Z. 
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2. The aim of this note is to study groups of birational automorphisms of a pro- 
jective hyperkahler manifold. Note that any bimeromorphic automorphism is bira- 
tional when a manifold is projective. Our main results are as follows 1 : 

Theorem 1.1. Let M be a projective hyperkahler manifold and G be a subgroup of 
Bir (M) . Then G satisfies either: 

(1) G is an almost abelian group of finite rank, or 

(2) G contains a non- commutative free group. 

In particular, so are Bir (M) and Aut (M) . 

Theorem 1.2. (Crescent Theorem) Let M be a hyperkahler manifold having at 
least two complex torus fibrations, say tfi : M — > Bi (i = 1, 2). Then M is 
projective. Assume furthermore that both tfi are Jacobian fibrations of positive 
Mordell-Weil rank. Then Bir (M) contains a non- commutative free group. 

Here by a complex torus fibration, we mean a surjective morphism / : M — ► B 
over a normal projective variety B, whose general fiber is a positive dimensional 
complex torus. (See [Ma] for fibered hyperkahler manifolds.) We call / a Jacobian 
fibration if M is projective and / admits a rational section, say O. The rational 
sections of a Jacobian fibration / naturally form an abelian subgroup of Bir(M). 
We call this group the Mordell- Weil group of / and denote it by MW (/). By abuse 
of language, we call MW (/) of positive rank if it contains an element of infinite 
order. See also [Cal, 2], [CF], [Og2] for relevant results. 

Theorem 1.3. Let S be a singular K3 surface. Put M := Hilb" (5). Then, both 
Aut (5) and Aut (M), whence Bir (M), contain a non-commutative free group. 

Here a singular K3 surface means a K3 surface having maximum Picard number 
20 ([SI]). Theorem (1.3) is a generalization of a famous result of Shioda and Inose 
[ibid], that every singular K3 surface has an automorphism of infinite order, in 
a non-commutative direction. Note that there is a projective K3 surface 5 s.t. 
p(S) = p and | Aut (5)| < oo for each integer p with 1 < p < 19 ([Ko, Ni]). So 
a statement similar to Theorem (1.3) is no more true for K3 surfaces of smaller 
Picard number p < 19. Theorem (1.3) also shows that the second alternative in 
Theorem (1.1) really occurs in each dimension. 

3. It is also interesting to compare these results with the following existing result 
and interesting open Questions: 

Theorem 1.4. [Ogl] Let M be a non- projective kyperkdhler manifold. Then both 
Bir (M) and Aut (M) are almost abelian groups of finite rank. In particular, they 
are finitely generated. 

Question 1.5. Let M be a projective kyperkahler manifold. Are Bir (M) and 
Aut (M) finitely generated? 

Question 1.6. (J.M. Hwang) Let M be a projective kyperkahler manifold. Is 
Aut (M) is of finite index in Bir (M)? 



The second Theorem (1.2) is inspired by a discussion with Y. Kawamata about remarkable 
difference of the appearance of crescent in Japan and Korea; it looks vertical in Japan while 
horizontal in Korea. This reminded me of the situation in Theorem (1.2). 
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In dimension 2, the first question is affirmative by Sterk [St] and the second one 
is trivial. The second question is asked by J.M. Hwang after my talk on a relevant 
subject at KIAS on March 2005. 

4. Our proof of Theorems (1.1)-(1.3) is based on two famous, deep results in linear 
algebraic groups; Lie-Kolchin Theorem and Tits Theorem ([Hm], [Ti]; see also [Ha] 
and Section 2 for the statements) and the notion of Salem polynomial (see eg. 
[Mc] and also Section 2). Unfortunately, our proof does not tell us much about 
algebro-geometrical reason why non-abclian free groups should be in the birational 
automorphism groups in Theorem (1.2). It would be interesting to find a more 
"geometrically visible" proof of Theorem (1.2), especially when M is a K3 surfrace. 
For this, an observation of Cantat [Ca2] might give us some hint. 

Acknowledgement. An initial idea of this note has been grown up during my stay 
at KIAS March 2005. I would like to express my thanks to Professor Y. Kawamata 
for his valuable suggestions and to Professors T.C. Dinh, J.M. Hwang, J.H. Keum, 

5. Morita and D.-Q. Zhang for their interest in this work. I would like to express 
my thanks to Professors J.M. Hwang and B. Kim for invitation. Last but not least 
at all, I would like to express my deep thanks to Professor S. Cantat for his several 
valuable comments on an earlier version of this note. 

2. Algebraic preparations 

The goal of this section is Theorem (2.6), the technical heart in the proof of 
our main results. In 1, we recall Lie-Kolchin Theorem and Tits Theorem (Tits 
alternative). Both are very important for our proof. We recall basic notions about 
lattices in 2 and a few facts about Salem polynimials in 3. We show Theorem (2.6) 
in 4. 

1. For simplicity, we shall work only over C. Let V ^ {0} be a finite dimensional 
vector space over C. We regard the general linear group GL (V) as an algebraic 
group defined over C, with Zariski topology. We identify GL (V) with the group 
GL (V)(C) of C-valued points in a usual way. A subgroup of GL (V) = GL (V)(C) 
simply means a subgroup as an abstract group. If G is a subgroup of GL(V), 
then its Zariski closure G, as well as the identity component of G, is an algebraic 
subgroup of GL (V"). First, we notice the following well-known: 

Lemma 2.1. Let G be a solvable subgroup of GL(V). Then: 

(1) Any subgroup of G and any quotient group of G are solvable. 

(2) G is also solvable. 

Proof. We only show (2). It suffices to check that [ G, G] = [G, G]. Note that [G, G] 
is closed in G (See for instance [Hm, 17.2]). Thus [G,G] C [G, G] . 

Let us show the other inclusion. Take g G G. Let us define the map a g by 

a g :G^G- f^f^g^fg . 

Clearly, a g is continuous and satisfies a g {G) C [G, G]. Thus a g {G) C [G, G}. Hence 
[G, G] c [G, G]. Let / 6 G. Let us define the map [3 f by 

h -G • g : ,/ • - r V7s ■ 
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Clearly, f3f is continuous and satisfies /3/(G) C [G,G]. Since [G,G] C [G, G], we 
have p f (G) C I^Gj as well. Thus /?/(G) C [G7G] and hence [G, G] C [G7G]. □ 

Lie-Kolchin Theorem and Tits alternative are the following: 

Theorem 2.2. (Lie-Kolchin Theorem, see eg. [Hm, Chap. VII, 17.6]) Let G be a 
connected solvable subgroup of GL (V). Then G has a common eigenvector in V. 

Theorem 2.3. (Tits alternative [Ti]) Let G be a subgroup of GL(V). Then G is 
either virtually solvable or contains a non-commutative free group. 

Here a group G is called virtually solvable if G contains a solvable subgroup of 
finite index. We also notice that any non-commutative free group contains Z * Z, 

1. e. the free group of rank 2. 

2. By a lattice L = (L, (*,**)), we mean a pair consisting of a free abelian group L ~ 
Z r and its (possibly degenerate) integral-valued symmetric bilinear form (*, **) : 
L x L — > Z. By Lk , we denote the scalar extension L ®% K of L by a field K. The 
signature of L is the pair of the numbers of positive-, zero- and negative-eigenvalues 
of a symmetric matrix associated to (*, **). We call L hyperbolic (resp. parabolic, 
elliptic) if the signature is (1, 0, r — 1) (resp. (0, 1, r — 1), (0, 0, r)). 

We call an element v e L \ {0} (resp. a sublattice M) primitive if L/(v) (resp. 
L/M) is torsion- free. We denote by O (L) the group of isometries of a lattice L. 
Note that |0 (L)\ < oo if L is elliptic. 

From now on until the end of this section, we choose and fix a hyperbolic lattice 
L of rank r. 

Then the set {v e Lfi\(v 2 ) > 0} consists of two connected components (w.r.t. 
Euclidean topology of Lr). We choose and fix one of them and denote it by V{L). 
We call V(L) the positive cone of L. In general, there is no canonical choice of 
the positive cone. (However, when L is the Neron-Severi group of a projective 
hyperkahler manifold, with Beauvillc-Bogomolov-Fujiki's bilinear form, we always 
choose the positive cone so that it contains ample classes.) 

Let V(L) (resp. dV(L j) be the closure (resp. the boundary) of the positive cone 
in Lr (w.r.t. Euclidean topology). By the Schwartz inequality, we have (x,y) > 
for x, y e V{L) \ {0} and the equality holds iff R>oa; = R>o2/ € dV(L). 

Let M be a primitive sublattice of L. Then M is either hyperbolic, parabolic, or 
elliptic, and is elliptic, parabolic, hyperbolic respectively. Here and here after 
we denote by M^, the primitive sublattice {v G L\(v,w) — Vw e M}. Note 
that M n M£ = {0} and M © is of finite index in L when M is hyperbolic or 
elliptic, while M n M£ = Ze with (e 2 ) = and M + is corank 1 in L when M 
is parabolic. 

3. In [Mc] and [Ogl], the notion of Salem polynomial plays a very crucial role. In 
our proof, it also plays an important role. We recall the definition: 
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Definition 2.4. An irreducible monic polynomial <I>(i) € Z[t] of degree n is called 
a Salem polynomial if the complex roots of $(t) =0 consists of two real roots a 
and 1/a s.t. a > 1 and n — 2 roots on the unit circle S 1 . 

In our argement, we need the following result. This is a formal generalization of 
[Mc, Proposition 3.3]: 

Proposition 2.5. Let L be a hyperbolic lattice of rank r and g be an element of 
O(L), preserving a positive cone V(L). Then the irreducible factors of the charac- 
teristic polynomial $ g (t) := det (tl — g) of g includes at most one Salem polynomial; 
and the remaining factors are cyclotomic. In particular, if c is an eigenvalue of g, 
then so is 1/c. 

Proof. Since 3> s (i) € Z[t] is monic, all the eigen values of g are algebraic integers. 
Since L is hyperbolic and g € O (L), it follows that g has at most one eigenvalue 
(counted with multiplicity) outside S 1 . Therefore by \detg\ = 1, g satisfies either 
that all eigenvalues are on 5 1 , or that g has exactly one eigenvalue outside S 1 , say 
a, exactly one eigenvalue inside 5 1 , say b, and r — 2 eigenvalues on S 1 . 

In the first case, the eigenvalues are all roots of unity by Kronecker's Theorem. 
So, the irreducible factors of $ g (t) are cyclotomic. 

Let us consider the second case. Both a and b are real by the uniqueness. Then, 
one can choose an eigenvector v with eigenvalue a in Lr. Then, by (v 2 ) — (g(v) 2 ) = 
a 2 (v 2 ), we have (v 2 ) = 0. Thus, v E V(L) (after replacing v by — v if necssary). 
The same holds for an eigenvector with eigenvalue b. Thus a > 1 and ab = 1 by 
g{V(L)) = V(L) and |det (g)\ = 1. Thus detg = 1 as well. Let f(t) G Z[t] be the 
minimal monic polynomial of a. Then f(t)\$> g (t). Since 3> a (0) = ±1, we have also 
f(b) = 0. Thus f(t) is a Salem polynomial. The zeros of the monic polynomial 
$ g (t)/f(t) G Z[t] are now on S 1 . Thus, again by Kronecker's Theorem, & g (t)/f(t) 
includes only cyclotomic polynomials as its irreducible factors. The last statement 
is now clear. Indeed, if c e S 1 , then 1/c — c is a zero of $ g {t). If c ^ S 1 , then c = a 
or b, and 1/c = 6 or a is also a zero of $ 9 (t) . □ 

4. Let us now formulate our key result: 

Theorem 2.6. Let L be a hyperbolic lattice of rank r and G be a subgroup ofO(L). 
Assume that G is virtually solvable. Then G is almost abelian of finite rank. 

Proof. We shall show Theorem (2.6) by induction on r. The result is clear if r = 1. 
So, we may assume that r > 2. We shall proceed the proof by dividing into five 
steps. 

Step 1. By the assumption, G has a solvable subgroup N s.t. [G : N] < oo. Note 
that G is almost abelian of finite rank iff so is N (cf. [Ogl, Section 9]). Then by 
replacing G by N, we may assume that G is solvable. We will do so from now on. 

Step 2. Put V := Lc- We have a natural embedding: 

GcO(I)cGL (V) . 

Let G be the Zariski closure of G in GL (V) and S be the identity component of G, 
i.e. the irreducible component containing the identity 1. Since G is solvable, so is G 
by Lemma (2.1)(2). Thus, by Lemma (2.1)(1), S is a connected solvable subgroup 
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of GL (V). Since G is an algebraic subset of a noetherian space GL (V), it has only 
finitely many irreducible components. Thus, [G : S] < oo. For the same reason as 
in Step 1, we may now assume that G is a subgroup of a connected solvable group 
by replacing G by its finite index subgroup GC\S, and that the positive cone V(L) 
is G-stable by further replacing G by its index two subgroup (if necessary). We 
will do so from now on. 

Step 3. Recall that G < GL(r, Z). Then, if all elements of G is of finite order, 
then their orders are universally bounded by some constant, say N. Then G is a 
finite group by Burnside's Theorem. In particular, G is almost abelian of rank 
and we are done. So, we may assume that there is go G G s.t. ordg = oo. We will 
do so from now on. 

Step 4. Since G is in a connected solvable subgroup, say S, of GL (V), by applying 
Lie-Kolchin Theorem (2.2) for S, we find a common eigenvector of G, say v G V = 
Lc- Set g(v) = a(g)v for jeG. Then a defines a group homomorphism 

a:G — >C X ; g ^ a(g) . 

Let M be the minimal primitive sublattice of L s.t. v G Mq- This M is G-stable. 
Indeed, since g G G is defined over Z and g(v) = a(g)v, one has M (~l ff(M) C M, 
(Mnj(M)) c = M c r\g(M) c and w G M c C\g{M) c . Thus u G (M f\g{M)) c , and 
therefore <?(M) = M by the minimality of M. 

Step 5. Note that M is either elliptic, parabolic, or hyperbolic. We completes the 
proof by dividing into these three cases. 

The case where M is elliptic. In this case is hyperbolic. Let K := Ker (rM ■ 
G — ► O (M)). Then K is of inite index in G and K C O (Mf ). Since rankMf < 
rankL, K is almost abelian of finite rank by the induction hypothesis. Thus so is 
G. 

The case where M is parabolic. In this case there is a unique primitive clement u G 
M s.t. (u 2 ) = and u G dV(L). By the uniqueness of u and by G{V{L)) = V(L), 
this u is G-stable. Since u G dV(L) D L \ {0}, it follows from [Og2, Proposition 2.9] 
that G is almost abelian of finite rank. 

The case where M is hyperbolic. In this case is elliptic (possibly 0). 

Consider first the case where ^ {0}, i.e. the case where M ^ L. Let 
K := Ker (tm ■ G — > O (Mf )). Then K is of finite index in G and K C O (M). 
Since rankM < ranki by the case assumption, K is almost abelian of finite rank 
by the induction hypothesis. Thus so is G. 

It remains to consider the case where M = L. In this case, the result follows 
from the next Lemma (2.7) (4). 

Lemma 2.7. Assume that M = L. Then: 

(1) The homomorphism a : G — ► C x is injective. In particular, G is an abelian 
group. 

(2) The characteristic polynomial < I , g (i) is a Salem polynomial. Here go is an 
element of G with ord go = oo in Step 3. 
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(3) Let g G G. Then there is ip{t) G Q[t] s.t. g = ip(go)- 

(4) G is an almost abelian group of finite rank. 

Proof. Let us show (1). If a(g) = 1, then v G 1). Here E{g, l)(c £ c ) is 
the eigenspace of eigenvalue 1 of g. Since <? is defined over Z, there is a primitive 
sublattice E C L s.t. i?c = E{g, 1). Thus, by the minimality of L = M, one has 
E = L, i.e. g = 1. Thus a is injective. 

Let us show (2). If a(go) is a root of unity, then there is a positive integer m s.t. 
ct{g™) = 1. Then g™ = 1 by (1), a contradiction to ord g = oo. Thus a(<7o) is not a 
root of unity. Thus, by Proposition (2.5), & go {t) has a Salem polynomial, say f(t), 
as its irreducible factor. If $ go {t) ^ f(t), then one can write & go {t) = f(t)h(t). 
Here h(t) is a product of cyclotomic polynomials by Proposition (2.5). However, 
since {fit), hit)) = 1 and f{a{go)) — 0, the decomposition $ 9o (t) = f{t)h{t) would 
lead a non-trivial rational decomposition of Lq, say Lq = L\ © L%, s.t. v € (^2)0- 
However this contradicts the minimality of L = M. Thus & go {t) = f{t) and the 
results follows. 

Let us show (3). Since & go {t) is irreducible by (2), the eigenvalues of g are mu- 
taully distinct. Thus the C-linear space W := {h G Endc(ic)|^.9o = <7oM is of 
dimension r. Since g is defined over Q, one has W = Wc, where W := {h e 
EndQ(LQ)|/ififo = 5o^}- Note that g£ (0 < fc < r — 1) are linearly independent over 
Q by the irreducibility of $> go {t). Thus (5o)fe=o f° rms a basis of W over Q. Since 
G C W by (1), the result follows. 

Let us show (4). Let F{c C) be the minimal splitting field of & go {t) over Q. Let 
Of be the ring of algebraic integers of F and Uf be the unit group of Of- Then 
a{G) C F by (3). Both a(^) and 1/0(5) (3 £ G) are zero of the characteristic 
polynomial ^(i) G Z[t] by Proposition (2.5). Thus both a(g) and l/a((/) are 
algebraic integers in F. Hence a{G) G Uf- By the Dirichlet unit Theorem, Uf is a 
finitely generated abelian group. Thus so is its subgroup a{G). Since a is injective, 
this implies the result. □ 

This completes the proof of Theorem (2.6). □ 

3. Proof of Theorems (1.1)-(1.3) 

In this section, we shall prove Theorems (1. 1)-(1 .3). Let M be a projective 
hyperkahler manifold. Then the Neron-Severi group NS{M) is a hyperbolic lattice 
w.r.t. the Beauvillc-Bogomolov-Fujiki's form. Let G be a subgroup of Bir(M). 
Then, there is a natural group homomorphism r^s ■ G — ► O {NS{M)). The 
kernel of r^s is a finite group by [Ogl, Corollary 2.7]. So, G contains a non- 
commutative free group iff so does r?js{G), and G is almost abelian of finite rank 
iff so is Tns{G). 

Proof of Theorem (1.1). Assume that rjvs(G) does not contain a non-commutative 
free subgroup. Then, by the Tits alternative (2.3), r^s{G) is virtually solvable. 
Thus rNs{G) is almost abelian of finite rank by Theorem (2.6). Q.E.D. 
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Proof of Theorem (1.2). Since Bi are assumed to be projective, one can write 
<Pi = ®\ v *Hi\- Here Hi is a very ample divisor of Bi and <&\ v >Hi\ is the morphism 
associated with the complete linear system \ip*Hi\. Put e« := \ip*Hj\ G NS(M). 
Then (ef) = (cf. [Ma]). Since Bi is Q-factorial and p(Bi) = 1 by Matsushita 
[ibid], it follows that R>oei i= R>oC2- (Here we note that all the arguments in 
[ibid] are valid if we assume that the base space is normal and proective, even if 
M is not assumed to be projective. Indeed, one can rewrite his argument [ibid] by 
using a Kahler class on M, instead of an ample class). Thus ((ei + e2) 2 ) > and 
hence NS(M) is hyperbolic. Thus M is projective by the fundamental result of 
Huybrechts [Hu]. 

Choose fi € MW (^) s.t. ord(/j) = oo. We naturally regard both /j as el- 
ements of Bir(M). Set G := (/i,/ 2 ). Then r NS (G) = (r NS {fi),r NS (f 2 )) and 
fNs{fi){^i) = e i f° r each i = 1, 2. By Theorem (1.1), it suffices to check that 
tns(G) is not almost abelian of finite rank. However, the proof of this fact is the 
same as [Og2, Theorem 1.6(1)] (except a few obvious modifications). Q.E.D. 

Remark 3.1. Our proof of Theorem (1.2) is based on Theorem (1.1) which, as 
we see above, involves a very deep result, the Tits alternative. By using the so- 
called table-tennis Lemma and some elementary results in hyperbolic geometry 
(see eg. [Ha, Sections 1, 3, 4]), one can also find a non-commutative free group in 
{ r Ns(fi),i"Ns(f2)) more directly. This is pointed out to us by S. Cantat. 

Proof of Theorem (1.3). By [Og2, Theorem 1.6(1)], every singular K3 surface S 
admits at least two Jacobina fibrations of positive Mordcll-Weil rank. Thus Aut (S) 
contains a non-commutative free group by Theorem (1.2). By the universality of 
the Hilbert scheme, Aut (S) naturally acts on M :— Hilb™ (S). This action is also 
faithful. Thus Aut (M), and hence Bir (M), contains a non-commutative free group. 
Q.E.D. 
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